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• SUM^IARY i 

This document is the third suppleniont to the Annotated Bibliography 
of Human Factors Laboratory Reports (1945-1968), Technical Report: 
NAVTRADEVGEN IH-158, February 1969, AD 686174. It provides a complete 
bibliographic reference and an abstract for each technical report of the 
Human Factors Laboratory published from 1976 through 1978. The citations 
are followed by journal articles and conference proceedings papers of 
members of the Human. Factors laboratory- published during the same period. 
Three indexes. Index by Source (contractor or in-house). Author Index, and 
Subject Matter Index are also included. 

Copies of reports cited in this supplement are not obtainable from the 
Naval Training Equipment Center. Department of Defense agencies, their 
contractors, and civilian agencies of the U. S. Government are serviced by 

Defense Dociunentation Center (DDC) 
Cameron Station 
Alexandria, Virginia 22314 

l^en ordering from DDC, use the accession number (usually beginning with 
AO) which appears at the end of the technical report bibliographic [ 
reference. 

The public can purchase copies of most of these reports (including this 
one) from . . 

National Technical Information Services (NTIS) 
5258 Port Royal Road 
Springfield, VA 22161 
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/ 1^76,.. 

Hausser/,D. , Blaiwes, A. S. , Weller, D. and Spencer, G. Application 
of computer-assisted instruction to interpersonal skill training. 
iNAVTRAEQUIPCEN 74-C-OlOO-l, Contract" N61339-74-C-0100, University of 
Michigan Institute-for Social Research. Jan; 1976, I09pp. A021474. 

A. study was conducted to investigate the application of the PLATO IV 
system to training interpersonal skills. Suitable content . areas were 
chosen and a mechanism to integrate various skill areas was designed. 
Training materials for this integration of skills were developed and 
coded into the PLATC IV system. A sanple of experimental and control 
company commanders was tested and trained. Data about their on-the- 
job performance in the s^all areas, as well as their companies' . . 
performance were collected and analyzed. ^ It appears that the training 
had an effect on skill performance of company commanders,, and' indirect 
ly on the attitudes and beliefs of their recruits. Less 'dffect on 
company performance was. observed, but there is evidence that the skill 
areas trained are related to success criteria used'. 
. * • 

iVfontemerlo, M. D. and Tennyson, M. E. Instructional systems development 
Conceptual analysis and comprehensive bibliography. NAVTRAEQUIPCEN 
IH-257, Naval Training EquipiiBnt Center. Feb. 1976, 286pp. AD24526. 

This report constitutes a first step in improving the state-of-the- 
art of instructional systems development (ISD). It contains a 
bibliography of about 4,000 entries divided into the following 
sections:- instructional systems development/systems approach to train 
ing, evaluation, methodology selection, media .selqct ion,, prograinmed 
instruction/computer assisted instruction, task analysis, job analysis 
task taxonomy, specific behavioral objectives, sequencing, instructor 
training, educational management, cost effectiveness, innovation,,' 
educational technology/ human engineering, simulation, and systems 
analysis/operations research. . ' 

This report also presents a conceptual analysis of ISD, a process 
whicli is also Icnown as: the systems approach to training (SAT), 
systems engineering of training (SLT) , training situation analysis 
(TSA), and the design of instructional systems (DIS) . The related . 
^ literature, dating from 1951 to the present, indicates the state-o.^- 
the-art to be unset::led. . Over 100 ISD manuals are available which 
contain fundajnerital disagreement on the nVjst basic aspects of course 
design. None of the manuals have been en^^irically validated. In an 
effort to understand the present staite of affairs with respect to ISD, 
. its history wa**v researched. : Its evolution was traced from its 
beginning in systems analysis, to the systems' analytic approach to 
training, to the proceduralized systems approach to training, which 
is now known as ISD. The factors which affected this evolution, the 
current state-of-the-art, and the major questions which remain 
unanswered are discussed. ' . , 
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1976 . - , ^ 

3/ Puig, J. A. and Gill, S. Evaluation of an automated flight training 
system: Ground controlled approach module (GCAMJ ■ NAVTRAEQUIPCEN 
...IH-264, Naval Training Equipment Center. ' Feb. 1976, 66pp. A021533. 

An experiment was conducted to determine the effectiveness of an auto- 
mated, adaptive system in training Naval aviators to fly ground con- 
trolled approaches' (GCA's). The training course was comprise! of 
Severn different types of GCA's, arranged in order of increasing diffi- 
culty. The GCA f.fodule (GCAM) was integrated vr.th a TA-4J Operational 
Flight Trainer (Device 2Fi)0). Conparison of automated and conventional 
training was made. In general, the hypothesis that training with 
the automated system would be as effective as conventional instructoi' 
training, was confirmed. 

4. Feurzeig, W. , Lukas, G. and >iuggins, A.^ W. F. Higher order adaptive 
training systems. NAVTRAEQUIPCEN 75-C-0104-4, Contract N61339-75-C-0104, 
Bolt Beranek and Newman, Inc. Feb. 1976, ^Dpp. A023594. 

A computer-based instrument flight simulatiqn system, ORLY, has been 
developed as the framework for an automated diagnostic and training 
: facility. ORLY-based protocol experiments were designed in v^ich 
student pilot difficulties shown in the course of carrying out IFR 
tasks were described and diagnosed by instructor pilots. Case studies 
of initial instructor protocols are described. Protocol analysis 
procedures and problems are discussed. 

5. Charles, J. P., Willard, G. and Healey, G. Instructor pilot *s role in 
..simulator training. NAVTRAEQUIPCEN 75-C-0093-^l, Contract N61339-75-C- 

0093,' Appli -Mat ion, Inc. • Mar.- 1976, .98pp. .AQ23546. ...... 

Instructor Pilot *s Role in Fleet Pilot Training using simulation was 
reviewed at the Readiness Training Squadron and Fleet Aviation Special- 
ized Operational Training Group Detachments. The role of the simulator 
operator/ teclinician was also reviewed. Both current and advanced 
operational flight trainers were analyzed. Conclusions and recommen- 
dations were developed. 

6. *=.Vreuls, I)., Wooldridgc, A. L. , Obermayer, R. W., Johnson, R. M. , Norman, 

D. A. and Goldstein, I. Development and evaluation of trainee perfor- 
mance measures in an automated instrument flight maneuvers trainer. 
NAVTRAEQUIPCEN 74-C-0063-1, Contract N61339-74-C-0063, Canyon Research 
Group, Inc. May 1976. 112pp. A024517. 

A simulator study was conducted to improve training performance 
measurement selection methods, apply the results to an automated 
flight system and conduct an evaluation of resulting measurement during 
automated l-rainin^ of four instnmient flight maneuvers.* 

Empirical methods were used to 'jeJect from an analytically derived set, 
those measures which had the ability to discriminatv^ between early and 
later training performance. The multiple discriminant model emerged 
as the best technique, but the algorithm for ii:; use was highly 
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modified. The automated trainer was then modified to operate on 
three measurement subsystems: (1) the original scoring algorithm; 
(2) the measures and weighting coefficients based on multiple 
discriminant analysis results, and (3) the original scoring algorithm 
using measured normative data. 

Insulting measurement was evaluated by automatically trained three 
matched groups of five civilian pilots each with the result that time- 
to- train was rcducod T^A-^Ol Cor i)ilots training with empirically 
derived measures over the original scoring algoritlim. It was recom- 
mended that data collection at an operational site be undertaken to . 
•verify the methods and to produce information 'that might lead to a 
• measurement specification for future devices. Recommendations con- 
cerning the design of adaptive logics were" made. 

Malone, T. B. , Delong, J. L. , Farris, R.. and Drumm, R. . L. Advanced 
concepts of naval engineering maintenance training (Volume I of II). 
NAVTRAEQUIPCEN 74-C-0151-1., Contract N61339-74-C-0151 , Essex Corporation. 
May 1976, 134pp. AO24860. 

This study was concerned with the feasibility of applying various 
^ 'recent advances in instructional technology to maintenance training in 
the area of marine engineering. The study is divided into four 
principal sections: requirements analysis ,^ media selection, training 
system description, and sysfem development planning. 

The j-equirements analysis identified all requirements which affect 
decisions concerning the lise of instructional technology. Baseline 
job 'requirements were established for a representative course of 
maintenance instruction, the Hagan Automacic Boiler Control (ABC) 
' course;. ■ These- jgh- requirements also included the tasks, skills, and ' 
knowledges for all relevant Hagan ABC' maintenance functions. 

This analysis was also utilized in -the establishment of course 
requi-rements 'including cours'e phasing requirements' and course content 
segmentation. Finally, training system requirements were\deve loped ■ 
which idcht if ied system capabiHties required to meet course 
requirements. \ 

The media selection technique which was developed for this study is a 
procedure for evaluating candidate media/method approaches in terms 
of relative effectiveness, usability, and dollar cost.* The aelphi 
method was used to rate alternate media on specific criteria, to 
establish the relatiye inportance (weighting) of criteria for' each 
training objective, and to integrate the ratings and importance weights 

The proponed engineering maintenance training system incorporates an 
audiovisual element and a programmable, modular simulator. A set of 
functional specifications and software requir<:^ments for the proposed' 
system were developed. ■ 1; 
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8-/Malone, T. B. , Delong, J. L. , Farris, R, and Drumm/ R. L. Advanced . 

-concepts of naval engineering rpaint^enance training (Volume II of II). 
' NAV;RAEQUIPCEN 74-C-OI5I-I, contract N61339-74-C-0151 , Essex Corporation. 
May 1976, 179pp. A024866. 

Sec Volume I abstract. 

9. Puig, J. -A. Requirements for color in television displays. 

NAViT^QUIPCEN TN 50, Naval Training Equipnient Center. June 1976, 
22pp. A02e747. ^ ^ ^- 

h ■ - * • A , 

' A review of 'the literature was made .as part of Task 572^-01, Wide- 
Angle High Resolution 'Collar TV Techniques for Training Systems. 
Forty-one references were consulted, twelve of which described 
research in applied' experimental settings Subjects in ten of the 
twelve studies showed some inprovement in performance as a result 
using color in the displays. The decision as to whether a color or" 
monochrome television system should be used appears to^be dependent 
on the specific application and cost factors. If either type could 
:be produced and maintained for "equivalent costs , then there is 
/-IS Evidence to suggest that perfonnance with color TV would be as good, 
and for .some applications, better than monochrome TV. 

10. Breaux'i. R. B. Training characteristics of the automated adaptive ground 
controlled approach radar controller training system (GCA-CTS). 
NAVrR/vEQUIPCEN TN-52, Naval Training Equipment Center. July 1976, 
36pp., AO27503. . "-s 

An initial feasibility study outlined a training system for laboratory 
test and eval-uation of an automated adaptive ground controlled 
approach controller training system for the precision approach radar. 
Evaluation of the initial system by GCA instructor led to a revision 

• of the model and of the [performance measurement system. This report 
concerns itself with that development process, with the current 
-laboratory systems, and with inplications for future training systems. 
The potential for team training by simulation of missing crew members 
is discu>ssed. . -ti 

11. Alilers, R. H. , Jr. Preliminary investigations concerning the training 
of tactical deu.lsion making behavior. NAVTRAEQUIPCEN 1)^-269, Naval 
Training Equipme'nt Center. July 1976, 32PP. A028722. 

j\n accelerating trend ^or military decision making in command and 
control .s-ituations is to provide the decision maker with statistically 

• processed data. There are obvious benefits to be derived from train- 
ing a decision maker to be a more efficient user of such diagnostic 

'Hata. But there is little empirical evidence that training is effec- 
tive in bringing about an enhancement of decision making performance. 

• T^wo experiments are reported in which it was attempted to determine 
the effectiveness of a scenario approach for training individualnS---t-o- 
make an abstract type of tactical decision based upon probabilistic 
data. Two questions were of interest in the first experiment: 

8 
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(1) Can appropriate decision making, behavior be shaped without" ^ 
^ providing specific .training in the underlying statistical-principles? 
and, (2) Can an' adaptive training procedurfe' be successfully utilized 

■ in^the training of a cognitive skill such' as dr. is ion making? The 
second experijnent was -designed to evaluate a teclinique of providing y " 
performance feedback in order -to mintain subject^ mot ivatiorl. • ' . 

It "was found that decision making behavior cari'^ bc ^shaped without 
providing explicit training., in' the underlying statistical principles. 
An' automated, adaptive procedure ..offered c§rtaiji advantages ^for \^ 
structuring \the training session. The perforriibicl3 feedback which was 
inherent va the adaptive model ^ appeared;^c provide sufficient motiva- 
tional cues. . ^• 

12. Cohen, J.. L. and FishbeinV M. A field' test of the-PIATO IV system for 
company commander behavioral change training"'. NAVTRAEQUIPC^ 74-C- 
0095-1, Contract N615::.9-74-C-0095\-l^-.iversity-: of Illinois . July 1976, 

_a28pp. AD27701. . ' 

A ^icLd experiment was carried out at the.>Rccruit Training Coimiumd, 
\ " Scin Uicgo, to tQSt the effectiveness of utilizing the PLATO IV system 
for behavioral change Li^zning. Thirty-eight company pom'-.cmders were 
randdmly assigned to either the experimental (training) or the control 
(no t^raining) group. Tlie results showed PLATO tio be a highly effcc- 
tive device for changing b^haviloral intentions, j PLATO also demonstra; 
ted, effectiveness in changing behaviors. ; 

13. Biictson, C. A. and Burger, iv. J. Transfer of training effectiveness: 
A7E night carrier landing trainer (NCLT) Device 2F103. NAVTR\£QJIPCEN 
74-C-0079-1, Contract N61339-74-C-0079, Dunlap and Assoc? ates> Inc. 

• Aug. 1976, 93pp. ' AD28S36. 

Two groups of Navy pilots who had no pr-iqj A7E experience we^e given • 
. differential training, in a Night Carrier 'Landing Trainer (NCLf) to ^ 
determine thje transfer of training to actual night carrier qualifica- 
tion (CQ) landing, the groups were matched on flight experience, 
training grades and amount of training. NCLT training was found to 
rninsfcr posit i.voly to ni^ht r.-irrior l.'indin;^ |HM-|V)nn.'inc<^. Strit- ist i cm 1 - 
ly si^'iii iiriuiL Ji LTerciiccs were Lound in objective measures of night 
Landing' Performan(;e Scores V.LPS) and niglit boarding rate as well as 
night LSO scores. Transfer of training was moie pronounced and 
.effective for inexperienced Category I pilots who were direct from the' 

■ training command than for .experienced Category I pilots. Radar 
fiieasures of final approach substantiated the night performance differ- 
•■•icos and indicated that NCLT trained pilots showed more precision in 

jrtical flight control than the non-trainer pijots. Attrition -rate 
was four percent for NCLT pilots compared to 30 percent for the no- 
trainer group. An extra 12 weeks training and^.l9 percent more flight 
time were required to qualify the attrites when they were recycled, 
through CQ training. Implications for future training- of carrier 
pilots and potential savings in trahiing and flight time are discussed. 
Recommendations for other NCLT training research and changes n NCLT 
aircraft response dynamics and relative motion cues are also presented. 
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14. Burger, W. J. and Brictson, C. A. A7E transfer of training effective- ' 
ness; Device 2C15A GPT and Device .2F84B OFT/WST. -NAVTRAEQUIPCEN.. 
74-C-0079-2, Contract N61339-74-C-0079, Dunlap and Associates vine. 

August 1976 i 55pp. A027691. , " * ' . 

Training effectiveness arid efficiency of two A7 aircraft training 
simulators was assessed within; their operational training environment .. 
using a qualitative assessment, method. Devices evaluated were the 
Coclq^it Procedures Trainer (Device 2Ci5A) and Operational Flight 
Trainer/ Weapon Systems Trainer (Device 2F84B). Observation of train- 
ing" activities, review of training syllabi and intensiyc interviews 
with 13 Phase Officers and Instructor Pilots were^ conducted. Results 
indicate that (1) both devices are effective traincrsy (2) the CPT ' . 

rates low on efficiency due to design and datedness of material, and^ 
(3) the OFT/WST is a relatively efficient trainer. Recommendations 
for enhancing efficiency of both devices, especially the OFT/WST are 
presented along with guidelines for the design of future simulator 
devices. ^- ^ " ' 

. ' --. ■ ■ , ■ 

15. Grady, M. W. and Hicklin,'M. -Use of conputer speech understanding in 
training: A demons t rat ioi^ training system for the ground controlled 
approach controller. NAVTRAEQUIPCEN 74-C-0048-1 , Contract N61339-74- 
C-0048, Logicon, Inc. Dec. 1976, ISOpp. A033327. 

This final report traces the evolution of the development of the . 
Ground Contx-dlled Approach Controller Training System (GCA-CTS)" from 
a feasibility demonstration to a preliminary training system. ^ The 
GCA-CTS combines sp^sech understanding, performance measurement., and 
adaptive syllabus control; thus the report traces the. development and 
application of tlicsc tccliriologics to the controller training "problem. 
In addition, the report describes a generalized research tool, the 
Voice Data Collection (!<TC) program, which supports the investigation 
of 'the advanced speech technologies in a variety of other training 
situations. 

16. Sugarman, R. C. , Johnson, S. L., Mitchell , J. F. , Hinton, W. M. , Jr. . 
and Fishbuine, Ri P., Jr. "E-2C Systems approach to training: - Phase i. 
NA\TRAEQOIPCEN 75-C-OlOl-l, Contract N61339-75-C-0101, Calspan Corpora- 
tion. December 1976, 120pp. A036264. . " , 

A revision of the instructional system for the E-2C was developed to 
enliance the cos't -effectiveness, of the training. The five-man E-2C 
crew consists of a pilot, copilot, combat infomat ion center officer 
(CrC) , air ..:ontrQl Officer '(AGO) , and flight technician (FT) , with 
training for these positions being conducted at RVAW-120, Norfolk 
. Naval Air Station. This project followed the "principles of Instruc- 
tional System Design (loD). After completing a task analysis for each 
position, the analysts prepared (in sequence) behavioral object Lves,. 
training support (media) ro({ui roincnts , :ind ie'sson spoci ficat ions. I'o 
support the effort, information was collected relevant to entiy ''• 
level 'behavior of trainees, existing resources available, and | 
external influences (constraints) that impact on the trai;.\ing 'system. . ^ 

. 10 - - -■■ , ^ ' 
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The proposed syllabi incorporate a shift dn enphasis toward: earlier 
"hands-on*' training, modified self-paced (individualized) instruction 
for most of the academic lessons; and a comprehensive plan for 
criterion- referenced performance assessment throughout the progression 
of cognitive (i.e. , .adademic) , practice/ and sortie/scenario lessons. 

After the implementation and validation process is carried out in 
Phase Ilv it is expected that significant reductions in training 
costs will be achieved through a shorter tota] course length, a 
greater proportion of synthetic training relative to In-flight 
practice, an(\ a quality control program. 

This report documents a particular implementation c5f I SD methods 
and procedures, selected by the contractor, which will be con^^ared 
by the Navy to other aircrew training, prograir. developments . Data 
provided will allow .evaluation of the methodology, definition of the 
constraints and operating condition3 that impact on aircrew training, 
.and acquisition off cost, scheduling and manpower data for future ISD 
planning. 
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Lukas, G. , Blaiwes, A. S. and Weller, D. Evaluation of human relations 
training programs. NAVTRAEQUIFCEN 75-C-0076-1, Contract^^NeiSSQ-yS-C- 
0076, Bolt Beranek and Newman, Inc. Jan. 1977, 179pp. AD37536. 

/\n evaluation was made of computer assisted instruction on human 
relations skills implemented on the PLATO IV computer system. These 
i^aterials had been devised for use by company commanders (CCs) at 
Naval Recruit Training Commands (RTCs) and were tested at the Orlando 
and San Diego RTCs. A substantial inprovement on the part of CCs, 
and recruits of CCs uiidei t^oing this instruction, was found. Also, 
case study scenario-based materials were implemented on PLATO IV for 
complementary training in interpersonal skills. 



Hughes, J. A. imd Hymcs, J, P. A study of the effectiveness, feasibili- 
ty, and T'^source requirements of instructional systems development: 
rA-6B readiness training. NAVTRAEQUIPCEN 75-C-OlOO-l, Contract 
N61339-75-C-0100, Courseware, Inc. Jan. 1977, 29Spp. AD35f)lG. 

This project was one of four aircrpw .training development projects 
sponsored by . the. Naval Training liqQipment^ Center (NAVTRAIiCUIPCliN) in 
a continuing study of the methodology, effectiveness, and resource 
requirements of Instructional Systems Development (ISO). It was a 
Phase 1 effort, covering ISD phases through lesson specification. 
Project goals were to study the effectiveness, feasibility ^ and , 
resource requirements of full-scope ISD, and to support the Replace- 

. ment Aircrew Training; Squadron in its* training program development 
efforts. , First, project goals, assets, and constraints were 
determined. A task listing of the two crew positions was ■ performed. 

■The listing was validated *'on operational squadron members through a 
survey, which also provided data used to select tasks tc: be trained. 
Tasks were analyzed into a hierarchical structure of supporting 
skills imd knowledges, which served as the basis for formulation of 
instructional objectives. Objectives were o'rgcUiized and sequenced, 
and altenuits4^e media selected for each lesson. Resource requirements 
were calculated for four alternative media mix -plans to aid in 
resource planning for later development and implementation. Lesson 
specifications (detailed instructional development blueprints) were- 
begun for the 1186 objectives, but were, not completed due to a 
shortage of subject-matter experts. It was' concluded that the ISO 
model used was feasible and sufficiently prescriptive for standard- 
ized emplo>TTient. Data on personnel requirements were gathered and 
processed' into a table for estimating personnel requirements in 
future projects. Recommendations were made for modifications to the 
basic ISD model and procedures, and for improved ISD implementation 
methods. 
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19. Cajnpbell, S. C. , Feddem, J., Grahain, G. and Morganlander, M. A-6E 
systems approach to training: Phase I final report. NAVTRAEQUIPCEN 
75-C-0099-1, Contract N61339-75-C-0099 , Grumman Aerospace Corp. 

Feb. 1977, 88pp. A037468. 

This report describes one of four Phase I programs, namely the A-6E 
TRAM Instructional Systems Development (ISD) Program, established to 
evaluate the application of a Systems Approach to Training (SAT) in 
Naval aircraft programs. Tlie research and development goals of this 
program were to: (a) evaluate a variety of ISD methods and procedures 
as applied to the aircrew training, (b) achieve a better understanding 
o£' the constraints and operating conditions that affect aircrew 
training, and (c) acquire cose, scheduling, and manpower data for 
future ISD planning. The operational goal was to design an A-6E TRAM 
aircrew training program. 

The approach ijsed to achieve the above goals conformed basically to 
the ISD methodology. The report discussed the Task Analysis, the 
development of Specific Behavioral Objectives (SBOs), the selection 
of instructional media, and the . formulation of Lesson Specifications. 

The . role of the Subject Ntatter Expert ,.(SME) is reviev;ed, as is the 
- rcciuircmcnt fur ({uant i tat ivc st:mdards of perfoniuuicc. Tnc opci'a- 
tional aspects of the A- hi: Training Program arc addressed: ^program 
costs and manpower data arc included. Specific media requirements 
and recommendations are presented. Generic descriptions of 
' appropriate training devices .are provided.- The report includes 'a 
.^number of conclusions and recommendations and a 30-item reference 
section. .. . 

20. R,icard, G. L. and Puig, J. A. Delay of visual feedback in aircraft 
simulators.. NAVTRAEQUIPCEN TM-56, Naval Training Equipment Center. 

, • Mar. 1977, 38pp. A037839. • ^ ' 

The literature of the m^mual control of systems incorporating delays 
in the presentation of visual information is reviewed for the 
. , development .of specifications To. Qight simulator visual displays. 

Sever.al casc*r-<fre presented where aisplay delays have affected the 
us^ of operational s imuJation devices, aiich~thc means* currently used 
to contend witli those delays arc discussed. fvJb'wipjiroaclics to 
preparing specifications, arc offerdd and available in'^formation 
relevant to each is presented. 

' 21. Porter, J. E., Grady,^!. W. , Hicklin, M. B. and Lowe, L. F. Use of ^ 

computer speech understanding in training: A preliminaiy investigation 
• of a limited continuous speech recognition capability. NAWR^EQUIPCEN. 

74-C-0048- 2, Contract N61359-74-C''0048 , Logiconi' Inc. Jun. 1977, 
.154pp. AO49680. ^ . 

This report describes the requirements for connected word speech 
recognition in training systems design. . A review of the published 
literature and commercially available systems ddnonstrates that 

■ " ■ . li . ..: ' ■ _ 
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no existing capability exists wiiich fully satisfies the unique 
features of speech recognition in training devices. A new approach 
toward limited continuous speech recognition was investigated based 
on examining the speech data itself to find characteristic sound 
structures; the order in which these sounds occur; and the time 
'duration of, and between, these characteristic sounds. 

Algorithms were developed and exercised over speech data generated 
by a commercial preprocessor for a large number of utterances spoken 
by a single speaker. Characteristic structure was found for the 10 
digits and the work ''point.*' Borrowing from the mathematical theory 
of formal languages, these "sounds" are termed transition letter sets 
The residual data were formed into loop letter sets which are used 
to reduce false recognitions. Nondeterministic finite t rani: duccrs, 
defined by the transition and loop letter sets for^ each vocabulary 
item, were exercised over entire utterances to validate the br.sic 
concepts and extract- time duration data. 

While the complete inplemcntation and testing of this mathematical 
^ machine approach toward limited continuous speech recognition remains 
■ incomplete , the preliminary results have verified the basic 
assumptions and provided the encouragement to proceed With , the 
development of the technique. 

Chatfield, D. C. and Gidcumb, .C. F. Optimization techniques" for 
automated adaptive training systems. NAVTRAEQUIPCEN 77-M-0575, 
Contract N61339-77-M-0575, Texas Tech University. Jul. 1977, 58pp. 
y\05263I.- 

As adaptive training systems are developed, the big problem 
encountered is the development of an adaptive logic. Current systems 
develop their branching schemes without direct usage 'Of learning 
- models. The literature presently contains several new techniques for 
optimizing instruction. These techniques make use of current learn- 
ing models by which to make trial-by- trial estimates of the. student's 
progress in learning. This information is then used to solve a set 
of equations which would select an optimal instructional alternative. 
Optimal decisions are made by selecting the instructional alternative 
for which the largest marginal gain in learning is predicted. The 
present ta^k was to' review the techniques available which present 
the greatest feasibility for applications in the developing training 
systems. The various optimization techniques selected were. presented 
in their mo:^t general form so that t .o variety of their • applications 
. might be apparent. It was concluded that the optimization tccliniqucs 
reviewed- were qui tc- fcasii5ie-and-have_ jiany„power_f ul...optiQns_to, oiif er. 
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Grady, M. W. , ilicklin, M. B. and Miller, R. M. Air intercept controller 
training: A preliminary review. NAVTRAEQUIPCEN 77-M-1058-1, Contract 
N61339-77~M-1058, Logicon, Inc. Jul. 1977, 115pp. Ad48796. 

'rhis report describes the current -Air Intercept' Controller (AIC) 
course conducted by the Navy. The report d: scusses the utilization 
of advanced technologies and training system viesigns to inprove the . 
AIC training program. 

Montcmcrlo, M. D. Trainin^^ device design: 'ri)c s ina^Iation/stimulat ion 
controversy. NAVrKAliQUIFCliN 111-287, Naval Training i.>;ulpnicnt Center. 
Jul. 1977, 75pp., A049973. - ^ 

Hands-on practice is a n^cessaiy aspect of most instructional pro- 
grams, and training devices are an accepted method for providing such" 
practice. However, the relative effectiveness of two different types, 
of training devices, synthetic trainers and actual equipment trainers, 
for providing this practice is a matter of . controvert. In the 
absence of a definitive answer, many training orgf. - 'lions have 
adopted policies limi-ting procurement to one type .evice or to the 
othei'. Yet, the successes that have been achieved with both types 
indicate that neither is .inherently superior to the other. This 

" report enumerates seven factors which have been found to affect the 
relative eifectiveness of synthetic and actual equipment trainers in 
particular situations: they are cost, reliability, maintainability, 
safety, facility requirements, training features, and modifiability . 
Examples are provided from the fields of: vehicle operator training 
fe.-^., piVots, helmsmen, astronauts), equipment operator training 
(c.^., power plnnt , und v^tMinr operators) and maintenance training. 
Special chapters are incliided on pierside. trainers and oil synthetic 

^ maintenance trainers. The purpose of this report is to aid those in. 
a position to select s>Tithetic and actual equipment trainers by 
making available to them the findings of others in a' variety of 
training situations. . ' 

Charles, J. P. .and Jolinson, R..M. Automaced weapon system trainer: 
lixpanded module for basic instrument flight maneuver. NAVTRAEQUIPCEN 
74-C-0141-1, Contract N61339-74-C-0141 , ApplNMation, Inc. Aug. 1977, 
200pp. A048498. . ^ 

Previous studies have demonstrated the conceptual and technical 
feasibility of automated Jind adaptive aviation simulator training. 
This st-.udy was concerned with exploring the impact. of operational 
syllabi and training requirements oi.\,.these advanced techniques. The 
-AdvanGed-,Je4: Ins tnmient Training Syllabus was selected and analyzed. 
A demonstration of the 'application of automated and adaptive 
tecliniques to the syllabus-was conducted utilizing the Rf|D simulator 
at the Naval Training liquipment Center. Several new approaches to 
per fonnance measurement, syllabus structuring and training control 
were developed to meet the syllabus ' requirement and training objec- 
tives. The techniques and applications were -successfully . 
demonstrated. 
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Charles, J. P. Instructor pilot's role in simulation training 
(Phase II). NAVTRAEQUIPCEN 76-C-0034'-l, Co;itract N61339-76-C-0034, 
Appli-Mation, Inc. Aug 1977, 57pp. A047919. 

Analyses of instructor pilot functions in trainL-'ig pilots using 
simulation were performed. The functions were based on the review 
of current simulation training conducted in the Phase I study, 
NAVTRAEQUIPCEN 75-0-0093-1. Feasibile allocations of functions were 
made and modular implementation concepts developed. 
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Daniels, R. W. , Alaon, D. G. , Stackliou^e, S. P. Generalized sonar 
operator trainlni'- Pinctional specification and evaluation plan. 
NAVTRAEQUIPCEN 7S-C-009:-l, Contract N61339-75-C-0095 , Honeywell , Inc. , 
Systems and Research Cenler. Jan. 1978, 151pp*. A053179. 

The objectives cf this prograjn were to develop the functional specifi- 
cations and an evaluation plan for a Generalized Sonar Operator 
Training (GenSOT) system. A previous study had established GenSO'l 
feasibility based upon similarities among^the tasks, skill, and 
knowledge required to operate a variety of surface and subsurface 
sonar systems. The current program focused upon implementation 
feasibility. 

/ The development of GenSOT was considered because a more cost-effective 
solution, for sonar operator training was needed. A trair^ing system 
was specified which is postulated to have the following advantages: 

. Increased sonar operator proficiency per unit of training 
time and cost . , 

Uecreased time required for skill transfer from one spniu* 
system to another. ' \ 

Increased sonar operator understanding of the .basic tunctibns 
of "sonar equipment to ensure optimal- equipment operation. 

In addition,, the following pl^ms were prepared to evaluate the con- 
cept under, operational conditions: ^ . ^ 

. : A pliin for the Introduction of GenSOT into the overall sonar 
operator training sequence. 

.■ ' - ' '\ 

A plan for measuring the cost of GenSOT and comparing those 
costs to current costs. * . . 

. An exi^erimental design for comparing the effectiveness of 
GenSOT -with current sonar operator training. 

Snlch, j;. Leal, A., Lucaccini, i;. , Gardiner, Hopf-Weichel, R. • 
/•^oaiysis of requirements and methodology for. decision training-:in 
operational systems. NAVTRAEQUIPCEN 77-C-OOOB-l, Contract N61339-77- • 
C-0005, Percept ronics. Inc. Feb. 1978, 207pp. A060028. 

To an ever- increasing extent , the operators of advanced. military . 
. systems, such as aircraft, ships , weapons , C3, etc.-, act primarily 
r as decision makers. Such job characteristics demc'ind Inclusion of 

decision training into the conventional militaiy training programs. 
. Within the past scleral, years, tlic general rules of effective decision 
making, have l^^en consolidated into the teclm ical , area tenned 'Vlecjsion 
'I analysis." During the same period, the. system approach to training 
has established a generalized TOth*odology for dealing uith diverse 
content areas in the design of training courses. This. report. 
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describes the results of a onc-year research and development program 
aimed at bringing these two areas together in order to define the 
decision-training objectives of typical military systems and to 
specify ways of meeting them in terms of a set of guidelines for 
generation of instructional materials for decision training systems. 

The program* is divided into four phases; (1) Job analysis phase, 
(2) decision task analysis phase, (3) development and evaluation 
phase, and (4) documentation phase. In the first phase, the SH-2F 
Light Airborne Multi-Purpose System (LAMPS) helicopter training 
system was analyzed. Based on this anallysis, the decision situations 
that- occur during emergency and tactical system operations were 
identified, and a number of decision tasks required to resolve a 
selected set of decision situations were chosen. These -decision tasks 
were the input to the second phase where they were analyzed to 
idcntiry the required facts, the underlying vonccpts, the decis ion 
rules, and the step-by-step procedure that detennine the o])rinial 
choice of alternatives. Based on the results of this analysi>, 
instruct Lonal guidelines were produced in th(j third phase. An 
evaluation plan was developed and decision aid syntenLS, to enliance/ 
/.^e effect of the decision training program, were suggested. y 

During the one-year prograjii a system to, generate instructional ^guide- 
lines for a task-specific decision training program, in any training 
environment, was developed. The system selects the most effectiye 
instnictiorial method and media and provides required instructional 
contents for any specific decision task, subject to training: in a- , 
specific training environment. The project has been aimed not only 
to develop a systematic procedure for. providing instructional guide- ^• 
lines for decision tasks encountered in LAMPS Mti -Submarine Warfare 
(ASIV) operation, but also to design a taisk- independent methodology . 
in order to make application of "the system in other task domains sub- 
,,ject..to minimal modification effort. Such a methodology, allows 
iru'on^orat ion of general purpose decision training components into 
tasl^ specif ic* decision traihing programs. This incorporation pro- 
vides trainees with the basic skills loquired for making task- 
specific decisions within a new domain,' in case of their transfer to 
other domains. I*urthcnnore, since the characteristics of decision 
tasks within any specific domain.^are subject to change with time, 
the methodology will allow, development of more effective training 
programs even in the case where there is no possibility of transfer- 
ring the tn neies to other task domains. 

The program. concentrated on ^ two major areas in the Navy, LAMPS (ASW) 
Operation: emergency operations and tactical operations. ;Th 
methodology . for both area.s. as well as the specific activities for 
the ejnergency operations are included in this report. The results 
of the specific activities for the tactical operations are described 
in a separate class iiied supplement.: . 
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29. (;ibbons,.A. S., llyiiies, J. P. Sll-ZF LANS^S instructional systems develop- 
ment: Phase II, final report. NAVTRAEQUIPCEN 76-C-0055-1, Contract 
N61339-76-C-0055, Courseware, Inc. -Mar. 1978, 292pp. A058793. 

This project was one of four aircrew training development projects 
sponsored by the Naval Training Equipment Center in continuing study 
of the methodology, effectiveness, and resource requirements of the 
. Instructional Systems"- Development process. It was a Phase II effort 
covering the ISD tasks from authoring through implementation and 
evaluation of the instructional system. Project goals were to study 
the effectiveness, feasibility, aad res.ource requirements, oi' fsll- 
.scofio ISD, and to support the l-lcct Readiness Scjiiadron in i (s tfviijilng 
•■ proi^r-un dove ! opinen t offorts. Instructional materials were nwihorcv.l 
and subjected, to a review process, produced in a tryout fonii and 
subjected to a tiyout witir typical students. Revisions wero made as 
appro])riate to the instructional materials , -following which the/ wc.re. 
' produced in a form suitable for the implementation imd ev^aluation of 
the entire instructional system.- An evaluation plan was written to 
support evaluation for small-scale try outs and for the large-scale 
tryout, and an implementaion plan was \vritten to 'prescribr. the 
♦.procedures and practices to be observed during management^ of the 
instructional system in actual use. VJhen all mate rials had been 
tried out and produced in final form, the i istructioEal system was 
implemented at two sites: Naval J\:r Station, North Isla^'id, on the 
'.West Coast and Ncival Air Station, Norfolk, on the East Coast. Llata 
was collected on the perfomiancc of the system and on pei'foniiancq of 
the instructional materials, and revision sped ficatior-LS were written 
necessary. An instructor trailhing course was developed and imjUe- 
niented to train instxnictors ,in specific tasks attendant to J.mi:)lemen- 
tnti.'U ,of the instructional system. It wa,s concluded that the TSl) 
model used was robust imd produced instructionally effective 
materials. Data on personnel requirements were gathered "'ind reported. 
A review of the effecttiverieijs of the iiistructional deyelopment model 
was made on a step-by-step basis, and. suggestions for .the future 
implementation of ISD in the Navy were made. 

50. .Proi)het, W. IV. II. S. k'lvy fleet aviation training program development, 
NAVT1^I:QII1PCHN 77-t:-0009-] , Contract .';61339-77-C-0009, Seville Research 
• (:onx)rat ion. Ntir. 1978, 85pp. A055788. 

Fpur sf)<>ci fie. aircraft training program development efforts (A-6li, 
J:-'2C, I--\-6R, and SH-2F) were examined and co^Tipared- as to methodology 
imd procedures used. Tlie four effort>i embodied principles of the 
^ Systems A])prpac!i to Training (SAT) and/dr . Instructional Systems 
. . Deveiopment (ISO) . Three. different contractors were involved, ;ind 
the programs were under the- technical direction of the Naval Training 
' ■ Iiquipmcnt Center. The four projects carried through 'the point in 

■ the SAT/ ISD process of development of lesson, specif icat ion documents. 
~In addition to examining procedural and methodological differences 
of the four programs, the repc^rt also described the various prog rajii 
. products and cxajnines their utility for subsequent steps in tlie 
SAP/ ISD process. " ^ ... 

19 . ■ 
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The report also examines the general model that has been evolving in 
a variety of NAVTRAEQUIPCEN sponsored efforts for the conduct of 
SAT/ISD programs. Tl^ model and its associated documentation are 
examined in terms of their utility for aviation training program 
developmental efforts. 

The report concludes that 'these various activities have advanced 
the Navy's capabilities significantly for the development of more 
effective aviation training program efforts in the future. Several 
areas are suggested for further improvement of the model. These 
• include: (1) making it mor^: cjpplicable to coinplex in-cockpit psycho-i 
motor skills (as contrasted with cognitive skills); (2) techniques 
of flight performance measurerient , and (?0^nie^ns of enhancing the 
role of simulator train-^in.g in the model. ""^--^ 

Blaiwes,' A. S. , Wellcr, D. R; and Rojnot, G. Development and^iinplementa- 
tion of a computerized evaluation and training system (CETS)^^at a ^ ^ 
Recruit Training Command. NAVFRAEQUIPCEN IH-300, Na:"^! Training- Equip^-^- 
incnt Center. Mar. 1978, 46pp. A054422. 

'Yhis report documents a one-year effort in which, some of the results 
of :m ea^^licr research and development project were prepared for 
imi)lcni£^ntat ion at a Recruit Training Command, lliis project concerned 
comjoutcr- based instruction for recruit company" commai-iders in the 
affective and communication skills areas. Tn an ongoing continuation . 

- of this effort, the. more complete preparation, implementation, cu'id 
evaluation of these capabilities are' 'underway. 

- Tlie program involved the use of a stand-alone computer-based system 
for evaluating and training company commanders and for obtaining 
infonnation needed for managing Recruit Training Command operations ^ 
in general. In accomplishing the'se functions, the computer -controlled 
the operation of a video tape player and a- card reader. in addition 

to some more traditional components 'of a' computer-based training 

- system. ,A new computer language vras developed especially . for facili- 
tating'; .the tr.'insfcM- of some progriuns previously prepared iji PL-VTO.IV 
coiljni> to :i fonn coir^)at ib'lc with the current computer system. . 

, .Prcliminaiy efforts to evaluate the feasibility and desirability of 
these programs indicated that the; system can operate as intended in 
the oiH^rational setting cUid that its acceptance by Itecruit Training ^ 
CommiUid personnel is generally -favorable. The results also indicated 
that the system would entail relatively small expenditures to. acquire, 
operate, iind maintain. ' . 
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King, W. J. and Duva, J. S. ATH: Bane or blessing for the technician? 
NAVTRAEQUIPCEN IH-301, Naval Training Equipment Center. Mar. 1978, 
98pp. A056336. 

Continuing its leadership of maintenance training R^D, the Human 
Factors Laboratory of the Naval Training Equipment Center, on 3-5 
May 1 9 7T7 convened the Second Biennial Conference on Maintenance 
Training and Aiding with the title: "ATE: Bane or Blessing for the 
Technician?*' Automatic Test Equipment (ATE) has been put forward as 
an aid to the technician arid it was the purpose of this conference 
to determine the extent to \\'hich this objective has been achieved. 

Because the design, and development of cost-effective training systems 
rccjuircs the laboratory' to keep abreast of critical training problem 
areas in the Fleet, the Naval Air Systems Command (AIR 340F, CPR 
Paul Chatelier) directed in 1976 that a Technical Advisory-^ Gro'ip 
(TAG)' for maintenance training be established with objectives' to: 

listablish a formal medium for. the exd)ange' of technical, 
information through a scries of biennial conferences and 
semiannual meetings to provide a broad interchange of mainte- 
nance research ideas. 

. Plcin and coordiriate tlfe~two' key areas of Maintenance Simulation 
and Training Devices, and Human Maintenance and Trouble -shoot- 
ing Behavior. ^ .\ :< 

It jyas under the TAG charter that the present conference on Automatic 
Tes^t'Equjpincnt was called. Representation wasofull/ tri^service 
both in terms ~of participants and attendees. As wiir.h the. First 
■Biennial Conference,, the present invited participants had tne advan- 
.. tage-of having read atl^thc papers prior " to thc*'meeting. Because of 
tills fcuiuliarity witli tJie'' toclmicai content , a rcaL exchange of 
tcclmical data ajid knowledge was^rossible. Hach participant had been 
asked to include some coverage of the following three elements of 
general interest. ~ ^ ^ ^ ' 

. . What is the author's involvement with' ATE? 

IVhat are the potential payoffs and penalties of ATE? 

. How does the teclinician use and interact with ATE? 

Brictson, C. A. A7 Training effcctiveneSi: through * performance 
analysis;- NAVrRyVEQUIPCEN 75-C-0105-1, Contract N61539-75:C-0105, 
Dunlap and As.^ociatcs, Inc. Apr. 1978, 60pp. ' AO56230 . 

■ ' . 

Training concepts which emphasize landing performance analysis, ' 
diagnostic feedback ai^d remedial instruction^ for novi.ce'A7 pilots are 
^'described. F(!I.P pcrroniuince is analyzed to identi fy low pcn'fonners 
who arc potential ivcycTe trainees. A Night Carrier Lajiding Trainer 
(NCLT) provides individualized remedial training to imprave eventual 
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.carrier landing performance . Results of a field test of the method 
-are presented. Fleet pertomiance of previous recycle trainees is 
reviewed and discussed along with recommendations for training 
implement at ion . 

Porter, J. E. -LISTEN:. A system for recognizing connected speech over 
small, fixed vocabularies, in real time. NAVl^RAEQUIPCEN 77-C-0096-1, 
Contract N61339-77-C-0096, Log icon,. Inc. Apr. 1978, 100pp.. AD56231. 

This report describes the ^ development of a system for recognizing, 
connected speech in real time usii.g a commercially available speech 
preprocessor, a minicomputer and programs written in FORTRAN. The 
system was tested on- two speaker? ,using the digits and the work 
^^point" with 'inconclusive rcr,ults'. Recognition accuracy of 86 percent 
was cicniovod Tar one si)eakcr whereas accuracy Tor the otlier speaker 
' was lower (39 [i^ercent) due to an anomalous difference bctwecn„ training 
and test d'^ta for that speaker's voice. ^ 

Ricard, C;. L., cyms, M.^M.. , Cox, D. C, Templeton, T. K. and 
•ThoiTipson, L. C. Conpensation for transport delays produced by conputer 
.image generation systems. NAVTRAEQUIPCEN IH-297/AFHRL-TR~ 78-46. .. Naval 
Training Equipment Center, Jun.' 1978. 60pp. .AO56720. 

Tliis/ report describes a cooperative Navy/ Air Force effort aimed at _ 
the problem of image- flutter encountered when visual displays that 
present computer-generated images are used for the simulation of 
certain flying. S' tuat ions. " Two ^experiments desciribLed that extend 

• laboratory work on delay compensation) schemes to the similation of 
formation flight in a research device the Advanced Simulator for 
Pilot Training". The scheme used was one where low-pass filters were 

... added to the lead-generation software of ' the visual display system. 

' Both studies' were geared to determining break-points for those filtei;s 
. that would allow adequate riyiiig control performance, and provide an 

' acccplablc display. TtTcsu cxpcr iiiicnts were based on the notion that- 
a trade exists between the suppression of the visual image's flutter 
and the removal of the low frequency information necessary ...for flight 
control..- One* experiment represented a factorial combination of 
settings of the display filters and the ribn-yisual cues of aircraft 
motion pi^ovided by the ASPT's g-seat and motion platform,- and ihe 
second represented a- simfrle comparison of 'filter settings. Both 
studies indicated that, at "least Cor fomad^ a ^ 

range, of filter scttinprs-wh.idv^will hot' adversely affect flight con- 
trol 'Cind will adequcitely .sui^press visual flutter. This range 
represents half:power settings for the filters of 3/4 to 1 Hertz. ,^ 

Charles, J. P. Instructor pilot's role in s:imulator training (Phase 
III). NAVTTUEpUIPCEN 76-C-0034-2, Contract N61339-76-C-0034 , Appli- ' . 
Nlation, Inc;\/Jm. i978, 57pp. A061732. ^ " ' , 

T!-iis third phase of the. study of the Instructor Pilot's Role in 
Sirrtulator Training was cop^rerned with the translation of the IP 
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functions into specification, fonnat. The problem addressed was the 
development of a conceptual subsystem* which could be utilized for the 
demonstration of the defined IP console- The primary result of this 
study indicates that .a console dn flight IP skills and capabilities 
is feasible. ' 



lluglies, J., O'N'cal, F. , Kearsley, G., O'Neal, H. , Fee, M. , Rodi, L. 
and Hermanns^, J. Functional spccificatibhs for computer aided training 
systems development and management ^'(GVT'SIM) support functions. 
NAVTRAEQUIPCEN 77-0018-1, ContractN61339-77-C-0018, Courseware, Inc. 
Jul. 1978, 121pp. A061245. . .. 

The scope and complexity of major instructional design* and develop- 
ment programs and the sophistication and detailed level .of definition 
of particular training^^development^ models utilized have greatly 
increased. Tne advanced planning and day to day management hecessary. 
for such programs have become commensurately more difficult and com- 
plex. The interactions between the many resource personnel and 
schedule requirements involved increase tho difficulty of identify ihg 
specific sources of problems and responding to them without causing . 
problems elsewhere. In addition, the models being* used tend^to have 
an increasing number of engineering characteristics rdther than' 
artistic attributes. That is,, they are characterized by increasingly 
well defined procedures and techniques which offer the potential far 
much better quality control consistency of output across different 
^personnel, and 'th^y simplify-'the problem of training and -.standardizing 
.approaches for develDpiSient staffs. In response to the challenges of 
these -emerging niodeis interest is - greatly-' increasi-ng -in-Gomprehensive — 
real-time integrated information management 'systems which* -incorporate 
a variety of fioxihle management projection ^and simulation.^ capabili- - 
ties, and which include rich arrays^ cjf standardized protocols , staff 
training materials, and interact ive' job aids. This report is a 
functional specification for a Computer Aided Training- System Uevelop- 
.ment and Management (CATSDM) environment based dn state-of-the-art 
hardware and software technology, and including recommendations for 
off the .shelf systems to utilize as a starting point, in addressing " 
the particular, systematic training and instruction design and develop^ 
ment model, described in MIL STD 961 [often referred to as. the Fleet 
Aviation ISD Model). / ^ ' ' • 

Hinton, W. M. , Jr. F-4J/N Instinjct ional systems development: .Phase I 
final report. NAVTRAEQUIPCEN 77-C-0081-1 , Contract N61339-77-C-0b81, 
Allen Cori^orat ion of America. JuJ.'1978, 153pp. AD61098. 

This project was one in a continuing Series of studies to upgrade 
Naval, aviation aircrew training prograjTis -and-at - the -_samc.itimc ^tr study 
the methodology ,. effectiveness , and resource^ requirements of Instruc- 
tional Systems De-VQlopment fISD). It was a Phase I effort encompas- 
sing ISD steps from liWraacchy development through training support - 
.requirements analysis • Proj"bct-^oals were to support the Marine and •••• • 
Navy Fleet >^ Readiness Squadrons'" in theix^training program development 
efforts and to study the utility of the^^&T^-^D model in an application 
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to an existing aviation system. The latter goal included gathering 
information on the strengths and weaknesses of the. model, making 
recommendations for modifications to the model,, and collecting 
resource utilization data. Input data came from a validated list 
of pilot and RIO tasks which was furnished by the government. Tasks 
from this list were analyzed into a hierarchical structure of support- 
ing skills and knowledge,. — Hi i s . analysis_formcd the basis 'for the 
doyclopniont of instructional ol)jcctives. 'Prefcrred--and_alternatc - 
media were selected for each of the objectives. Objectives^ete-theii 
grouped into lessons and the lessons sequenced to form the pilot^ 
and RIO syllabi.^ Finally', a training support reqL>i.iements analysis 
was performed' to estimate resource requirements for development, \ 
implementation, revision, and maintenance of the two training cour^ses; 
Problems encountered during this program were discussed and recdmmenda 
tipns for Changes to the I SD model were presented. : 

■ ' \ ^ ■ * ' \ 

39. Puig, J. A., Harris, W. T. and Ricard, G. L. Motion in flight Simula^ 

tion: An annotated bibliography. MVTRAEQUIPCEN IH-298, Naval Traini 
Equipment Center. Jul. 1978, 745pp. .AD61687: 

,In support of Project 7744 - iMotion Drive Signals for Flight Simula- 1 
tors, a Review of the. literature concerning motion simulation was . ; 
conducted. Abstracts.were included for 6.82 references. A primary ' 
objective of this review was to compare data from" the. various studies 
to identify general trends on the effects o£ motion on performance . 
' . and training. The; piil^l icrit ions were, lifted alphabetically by autlior,, 
claronologic:iI ly , ruiil also grouped into eight major categories as ^ 
■ „ * . follows:- reviews.-;ihdAbibliographies_; equipment._desj3^^ ; require- 

ments; algorithms and drive techniques; effect ions of motion, evalua- 
tion;', vertical motion, and coKt, effectiveness. . . 

40. Blaiwc^, A.* S: and Welle r, D. R. ^ computerized evaluation and training 
system (GETS) for recruit training commands: An. overview. NAVTRAEQUIP- 
CEN IH-307,' Naval Training Equipment Center. Nov. 1978, 36pp. ^ • 

riiis^ report provides a synopsis.vOf a six-year research and development 
.1, effort to investigate the feasibility and desirability of using com- 
puter assistance to inijirovc leadership and management practices at 
Rl'Cs (Recruit Training Commands). ^ Information has been derived on 
the suital,)ility of two computer' systems and various approaches for 
employing .these .systems in pursuit of this goal. These approaches ' 
encompass ins true tion/and performance evaluation for Company 
Commzmdcrs {CCsT tis well ns* more general information acquisition and 
processing capability to assist in the management of RTCs. Some of 
these programs are ready for operational use, while others would 
require considerable development and testing prior to operational* ■ 
implementation. « ; . 
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Hooks, J. T., Butler, -E. A., Gullen, R. K. and Petersen, R. J. * . 
Design 'Study for an .aiito- adaptive landing' signal officer 1[LS0) training 
system. NAVTRAEQUIPCEN. 77-C-0109-1, Contra:ct ^^61339-77-0-0109^ 
Logicon, Inc. Dec. 1978, 207pp. AD64339c " . 

'fhis final report' describes candidate performance capability require- 
ments for an automated, adaptive 'Landing. Si^al Officer (LSO)^ training 
system. -' The. system includes adaptive training control, a wide-angle 
visual isystem automated Speech understanding, automated perfo'rinance 
measurement^and a 'Simula ted LSO workstation. The report traces the 
derivation of -system capabilities by addressing LSO job .analysis , LSO 
training requirements, system utilizatioik syllabus, system functions 
and* assessment of . relevant .;tec;hhology. The . report also includes the 
design of -n laboratory system for concept demonstration 'and cxpcrimen-^ 
tatiun. A' significant bibiiugrapliy.-^is incllided. • 

IVeller, D. R. and Blaiwes,- A. S. . Computer- ass is ted judging and feed- 
back' of. interpersonal skills. ' NAVTRAEQUIPCEN IH-308, Naval\ Training 
Equipment Center. Dec. 1978, 45pp." A066222. ■ ' . 

Training tecIiTiO logy, in the interpersonal skills area has « riot kept 
pace Witfi tho traijii.-\g technology that is available in most other 
skill areas. The deficiencies in "^interpersonal skills training are 
especially apparent irx '*job oriented" instruction,' wherein the student 
performs operational tasks in simulated or actual job situations*^. A\ 
major obstacle.^ to the application of job .oriented instruction. to this 
.area is the difficulty in providing appropriate feedback to the ' , 
student/ concerning his perfornjance in the inteipersonal si^^^^^ . '_ 

One. of the most popular^ approaches to satisfying this feedback 
requirement is to videotape the student in .interpersonal sittiations. 
Nfost such efforts, however,-, fall qiiiite s;hort of providing appropriate 
feedback and the general Tailure to demonstrate training- benefits from 
the use of this method ciux bo attributed to tlvis shortcoming. Further, 
tlie costs and difficulties associated with providing adequate feedback 
regarding interpersonal -performance apparently have discouraged ^ 
attempts to do so. " . • " 

ITiis report presents an approach for decreasing some of these costs 
•and difficulties.. This approach. uses a coirputer to assist in the 
process of eliciting appropriate feedback. from judges and providing; 
this feedback to-.,the student, both in coordination wi th the \i.deotapedc 
recordings of the student's performance. In this regard, conputer 
programs designed to help a judge rate interpersonal performance ? 
along a variety of dimensions were developed and tested. Although 
these programs ""also are suitable for providing feedback to the student, 
formal t^'Sts of this aspect of the process were not conducted in the 
present research. * Formal, aibeit brief, e^qjerimental evaluations of 
the feedback elicitation and development programs were conducted, 
• however.. ' ' . ' . . - 
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Several potential benefits of the procedures for interpersonal 
skills training were demonstrated as a result of both the formal 
and informal' tests of the system. 
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Wcllcr, n. R. and Blaiwcs, A. S. Leadership dimensions of Navy 
recruit company commanders and recruit morale, and. performance. 
Psychological Reports , 1976, 39, 767-770. 

...Leadership dimensions and their relation to ^recruit satisfaction 
and performance' were studied in 73 company commanders. Recruits 
■ completed questionnaires assessir.g conpany commanders' behaviors 
and recruits' attitudes. Factor analysis yielded four factors, 
Fluinan, Informative, Warm, and Effective Communicator. The Human 
and Warm factors were cons-istent with interpersonal conponents 
found in prior research, but the Informative and Effective 
Communicator .factors were only marginally consistent with task 
components found previously. Correlations were< computed between 
tiie factors and the satisfaction and perfomiance of recruits. All 
factors correlated k ignificantly with recruits' satisfaction, hut 
only the liuiiian factor correlated significantly (negatively) witii 
recruits' per fo nuance. Possible reasons for the lack of a traditional 
task component arc discussed. 

I'euge, R. i^. ,' .Grady , M. W. and Breaux, R. Air. tactical training and 
the automated speech technologies- Future of Simulators in Skills 
Training , First Inteinational Learning Technology and, Exposition, on 
Applied Learning Technology, JuL 1976. 

Applications of the* automated speech technologies of computer speech 

■ recognition and speech synthesis to pilot training were discussed. 
Specifically, speech synthesis was used to rep lace*^ ground radar 
controllers and consideration was given for replacement of other team 
members such as the pilot, radar intercept officer, and weapon 
systems officer. The enhancement provided the overall system is to 
relieve the instructor of playing the. role of these team r ..mbers , 
and thereby provide increased efficiency and .effectiveness of the 
instructor* . ' • 

!*uig, The t raining el' Lcctivencss of simulation. Proceedings 

of the First international Learning Technology Congress and Exposition, 
Washington, D. C. , 71 - 23 Jul- 1976. 

A simulator, regardless o£ its teclinological sophistication will 
provide effective training only if used in a well designed and 
managed training system. Engineering conplexity by itself does not 
guarantee effective training; training is far more dependent on 

■ psychological fidelity.. For mciny years, the Naval Training Equipment 
Center lias been engaged in a long term program of in-house and' 
contractual studies designed to evaluate the' effectiveness of training 
devices. This paper, by describing. some of these studies, provides 

an indication of the effectiveness of simulation in training. Also, 
some of the problems that arise in attempting to conduct field 
evaluations, were discussed. ' - . 
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46. Breaux, R. and Grady, M. W. The voice data collection program. 

,.Proceedings of the 9th NTEC/Industry Conference, NAVTRAEQUIPCEN IH-276, 
^ ^ Orlai^do, Florida, 9-11 Nov. 1976. AD31447. . 

A generalized research tool for laboratory study of voice data for 
various vocabulary sets, was described. The system allows run-time 
definition o.: any particular vocabulary, English text presentations 
• as prompts to the speaker, automated voice synthesis pron5)ts to the 
speaker, collection of voice patterns, verification of these' patterns 
prior to creation of reference patterns, creation of reference 
patterns, and validation of the patterns. Output to the experimenter 
includes accuracy data, prompts, responses, statisticrxl summaries, 
and. parameter values available for adjustment. 

47.. . Ricardj G. L* , Norman, D. A. and Col Iyer , C. Compens at ing for f 1 xght 
' simulator .CGI system delays. In Proceedings of the 9th l^EC/ Industry ' 

Conference, NAVTRAEQUIPCHnI IH-276, Orlando, Florida,, 9-11 Nov. 1976. 
. A031447. 

Three exi)eriments are presented that describe the development of a 
compensation scheme for the delayed visual feedback characteristic of 
fl ight s imulator visiial displays. The scheme consists of predicting 
future values for paranieters which affect a display and then low-pass • 
'filtering them. The experiments present background data on the 
effect of delays, data fcr setting the break' point of the filter, and 
a training assessment of the scheme. 
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48. Blaiwes,' A. S. and Weller, I). R- A social simulator: Development. 
" ' and evaluation. Education Technolo gy, Mar. 1977, XVII(3}, 14-20. 

This report -discusses- the need, for and characteristics of a 
^jimulator designed for training interpersonal skills. This 
discussion includes descriptions of initial efforts to develop and 
evaluate some aspects of sucli a ''social simulator". The ir^er- 
personal situations between conpany commanders and recruits at 
Recruit Training Commands served as the primary vehicle for research 
and development in these efforts. 

49. Breaux, R.'B. Laboratory demonstration of. computer speech recognition 
in training. In Proceedings of the 10th OTEC/ Industry Conference, 
NAVTRAEQUIPCEN IH-294, Orlando, Florida, 15-17 Nov 1977. AO4790.5. 

A system was described v^iich provided a laboratory evaluation of 
' the feasibility of the use of computer speech recognition in training 
• Results indicate potential manpower cost reductions and training 

enhancement. Follow-on experimental prototype system are described. 

30. -Breaux, R. B. Laboratory demonstration of computer speecli recognition 
in training. Proceedings .of the Workshop on Voice Technology for 
Interactive Real-time Command/Control Systems Application,. Moffett 
- Field, CA, 6-8 Dec 1977, 109-116. . ' 

A system was described which provided a laboratory evaluation of 
the feasibility of the use of computer speech recognition in 
training. Results indicate potential manpower cost reductions and 
training enhancement. Follow- on experimeutal prototype system are 
described. 
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51. Ricard, G. L. , Cyrus, M. L., Cox, D. C, Tenpleton, T." K., and 

Thonipson, L. C. Signal adjustments for formation flight in the ASPT. 
In Proceedings of the 6th Symposium on Psychology in the DoD. Apr. 1978, 
147-151. 

This is a preliminary report of an effort documented in NA\TRAI:QUIPCEN 
in-297/AMIW,'TK-78-46. In this report., an adjustment to the signals 
*^ used to drive the ASPr CGI visual system is' described that allowed 
the device to be used for formation flight, and some data, related 
to the adjustment are presented. 

52. Van Ilcmcl, P. H. Operator and technician tasks for the head-up display 
-test set and versatile avionics shop test (VAST). In Proceedings of 
the Indus try /Joint Services Automatic Test Conference and Workshop . 

SSsKIngt^n^^IJ^^ 

The tasks of operators and^technicians for the AN/AVM-11 (V), A7-E 
Heads -Up Display Test-Sot, and for the ■AN/US^-247 (Y) , Versatile ^ 
Avionics Shop Test (VAgT^)^ are described and conpared. The t^sks fall 
into overlapping categories that are common to operators and techni- 
cians and across type of Automatic Test Equipment (ATE), with a 
reJarfively-^Small proportion identified as tasks specific to operators 
^-^r technicians^, for particular' equipment . There may be some tasks, 
involving analysis of test program sets, that do not fall into the 
category of taski^ traditionally required of operators or technicians. 
Such t^isks nuiy become more important in ftJt'ure 'generations of ATE. , 

53. Harris, S. T. , Puig, J. A., Ricard, G. L. and Weinman, G. Motion: 
Methods and requirements. Paper 78-1576, presented at the AIAA Flight 
Simulation Technologies Conference, Arlington, TX, 18-20 Sep. 1978, 
38-45.- ■ 

' t> 
At 'the present- time, the role of motion cues in the effectiveness and ^ 
efficiency of simulator training is not certain. Before valid train- 
ing effectiveness studies can be acconplished for motion cueing, the 
nature of the drive signals for motion platforms and their relations 
to actual aircraft motions must be accurately determined. Thi^ paper 
reports plans to: (1) Assess the training effectiveness of several 
•of the flight simulator motion-system drive algorithms in current use, 
(2) Select the most training effective, (3) Develop them for 
specific, Navy tasks, and (4) Relate them to characteristics of- the 
motion systems. The stages of this project; engineering analysis, 
preliminary algorithm selection, and training effectiveness evaluation 
rire presented herein. 
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Ricarci, G/' L. and Harris, W. ,T. Time delays in flight simulators: 
Behavioral and 'engineering analyses,. In AIM Simulation Technologies 
Conference , Sep. 1978, 169-175.'" . ^ . . 

Problems of control producied by delays in simulations .of flight are 
reviewed and data' related to the problems that were available, from 
an earlier experiment were analyzed. That study used a lead/lag 
transfer function to compensate for delays inserted; into a closed^ 
loop system, and, pilot control performance was measured using 
various amounts of lag for a given settirl'g of lead. These data 
indicated that an optimal^ ratio^of lead to lag could be determined, 
and based upon tfie changes of phase and gain associated with 
subjects' best control performance, suggestions are made concerning 
compensation for delays. . 

Col Iyer, S. C. and Chambers , W. S. AWAVS, a research facili ty for 
dcriiiiriK TIik'^^ I i nor visual system requirements . - Proceedings u T 
the Hiiium factors Society , 22nd Annual Meeting, Detroit, MI, 16-19 
Oct: 1978. / . • 

, The objective of the. Navy's Aviation Wide Angle Visual System 
(AWAVS) program is to recommend design criteria for future flight 
simulator visual systems. Research leading to Lhis goal will have 
two facets: improving visual system technology, and deteimining the 
effects of viisual" system parameters on pilot performance and training. 
The experimental facility is described, and the behavioral research 
plans are discussed, with emphasis on the carrier landing studies to 
be conducted during the first phase of the program. 

King, W. J. New concepts in maintenance training. Aviation Engineering 
and Maintenance Magazine , Oct/Nov 1978. 

This article outlines ongoing NAVT.RAEQUIPCEN research into hands-on, 
intermediate levels maintenance training whe^e the technician has to 
troublcshoot malfimctions down to a component on a printed circuit 
f)oarcl, Approaches using 2-D media as well as a 3-U arc described, 
and potential commercial/ industrial applications are discussed 
briefly. 

Norman, D. A. Recent developments and plans for pilot training 
devices. Procee dings, Society of Automotive Engineers, Inc ., .. 
Aerospace Meeting, San Diego, CA, 27-30 Nov. 1978. 

Hvolvcd from a research tool, tlic first of ^a family of very-low-cost 
part- task training devices is now being developed aind will shortly 
tenter cLj\ evaluation phase. Key to the low syistem cost is use of a 
rni nicoinjiutcr and graphics display in a small, stand-alone cabinet. 
Training features are concentraj:ed in- software, stored in a librar>' 
of di!;kettes. Low cost and portability of systejiis should lead to 
,wider availability of re ""resher training and consequent increases in 
readiness and safety. 



NAVIMliQlJlPCliN 11I-1S8 



ERIC 



INDEX BY .SOURCE 

Allen Corporation 58 

>\ppli-Mation, Inc, 5, 25, 26, 36 

Bolt Beranek and Newman, Inc. 4, 17 ' 

Canyon Research Group, Inc; 6 - 

Calspan Corporation 16 . . / 

Courseware, Inc. 18, 29, 37 , 

Dunlap and Associates, Inc. 13, 14, 33 " ; 

Essex Corporation 7, 8 
• Grununan Aerospace Corporation .19 
lloDcywcTl , ' Fnc. 27 

in lloaso i, 3, 9, 10, li, 20, 24, 31, 32, 35, -39, 40, 42 

Logicon, Jnc. 15, 21, 23, 34, 41 .-^^ 

Pcrceptronics , Inc. 28 

Seville RcscarclV Corporation 30 

Texas Tech University 22 ^ 

Ui^iversity of Illinois 12 „ 

Ihiversity of Michigan 1 . 



32 



.NAVTRAEQUIPCEhr IH-ISS' 



AUTHOR INDEX 



Ahlers, R. H. , Jr. 11 

Alden, D. G.-- 27 

Blaiwes, A. S. 1, 17, 31, 40, 42 

,4.3, 48 

. Breaux, R. B. - 10, 44, 46, 49> 50 

Brictson, C. A. 13, 14, 33 

Burger, W. J. 13, 14.. 

Butler, n. A. ' 41 

Cajnpbe] * , S. C. 19 

auinibers, IV. S. 55 

.Charles, S. P. 5, 25, 26, 36 

Ctiatfield, D. ^C. 22 

Cohen, J. L. 12 

Collyer, S. C. 47, 55 

Cox, D. C. 35, 51 

Cyrus, M. L. 35, 51 

Daniels, R. W. '^27 

Delong, J. L. 7, 8 

Drum, R. L: 7,8 

Duva, J. S. 32 

Farris, R; 7, 8 

Feddem, J. 19 ' 

Fee, M. 37 

F'cugc, R. L. 44 

Feurzeig, W. 4 

Fishbein, M. 12 

Fishbume, R. P., Jr. 16 ^ / 

Gardener, P. 28 ■ i 

(ahbons, A. S. 29 

(lidcuml^, C. F. 22 • 

Gill, S. 3 

toldstein, I. 6 

Grady, M. W.- 15,. 21, 23,^ 44, 46 

Graliam, G. - 19 ' 

Gullen, R. K. 41 

Harris, W." T. 39, 53, 54 
^ Ikiusscr , !). 1- 

llcaley, G. 5 

Hermanns, J. 37 

fiicklin, M. B. 15-, 21, 23 

Hinton, W. M. , Jr. 16, 38 

HooLs, J. T. 41 

Hepf-Wcichel, R. 28 

Huggins, A. W. F. 4 

Hughes, J. A. 18, 37 

Hy-mes, J. P. 18, 29 

Jolmson, R. M. 6, 25 

Jolinson, S. L. 16 

Kearslev* G. - 37 ' ^ ' 

King, W. J. 32, 56 

Leal, A. 28 

Lowe, L. F. 21 • 



\ 



Lucaccini, L. : 28 

Lucas, G. ' 4, 17 • 

Malone, T. B. 7, 8 

Miller, R. M. 23 

Mitchell, J. P. -16 
. Montemerlo, M. D. 2, 24 

Morganlander, M. 19 

Normarij D. A'. 6, 47, 57 

Obermayer, R,, W. ^6 

O'Neil, P.- 37 

O'Neil, H. 37 - ' 

Peterson, R. J. 41 
• Porter, J.- E. ' 21, .34 ' 

Prophet, W. W. 30 ' • ^ 

.Piiig, J. A. ,.3.,.-9^-.20,--39i 45; 53 

mcard, G. L. 20, 35, 39, 47, 51 
53, 54 

Rodi, L. ' 37 

Romot, G. . 31 

Saleh, J.' 28 

Spencer, G. * 1 

Sugarman, R. C. 16 
\ Stackhouse, S. P. 27 
\ Templeton, T. K. 35, 51 
\Tennyson, M. E. 2 

\rhompson, L.* C. 35, 51 

YanHemel, P. E. 52 • 
. Vreuls, D. .6 

Weinman, D. G. 53- - 

Weiler, D. 1, 17, 31, 40, 42, 43 
48 

Willard, G. 5 
Wooldridge, A, L. 6 



3 / 



ERIC 



NAVrRAliQUIPCraJ IH-158 



" • . SUBJliCl' MA'lTJiR INDEX 

Adaptive Training '3, 4, 10, 11, 25-. 
Attitude Behavior Relationship 12 
Autoniated Adaptive Training • 15, 22, 23, 41 
Automated Speech Understanding 10 
Automated training 3, 10, 22, 25, 41, 44, 46, 49, 50 
•Zomputer Aided Training Systems Development 37 
Computer Assisted Instruction 1, 2, 4, '12, 17, 31, 40, 42 
Controlled Training ' 15, 21, 23," 34 
I)ecision Training Methodology '28 
Delay Gomnensation 2G, 35, 47, 51 . 
Display Delay (lag)- 20, 54 
Flight Training 3, 4, 22, 30, 39, 55 
Generalized Training 27 
Human Relations Training 17, 31, 40, 42 
Instructional Systems Development ^ 2, 16., 18, 19, 28, 29 
Interpersonal Skill Training - 1, 17, 48 
i\5() Training System 41 

Leadership Training 1, 17, 31, 40, 42, 43 
Maintenance Training 7, 8, 32, 52, 56 . 
>VDtlon Simulation 39, 53 

Performance Measurement 3, 6, 10, 1-5, 22, 23 
Simulator Training 5, 25, 26, 30, 36, 55 
Sonar 27 

Speech Understanding 15, 21, 23, 34, 44> 46, 49, 50 
Systems Approach to Training 2, 16,- 18, 29, 30, 38 
Tactical Decision Making 11 
Training 11, 14, 32, .33, 45,;S7 
Training Device Design '24 
Transfer of Training 13, 14 • 
Visual Simulation 9 



34 



